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We derive the equations of linear cosmological perturbations for the general Lagrangian density 
f{R, 4>, X) /2-\- Cc, where J? is a Ricci scalar, is a scalar field, and X = ~d'^(t>d^(t>/2 is a field kinetic 
energy. We take into account a nonlinear self-interaction term Lc = ^{(f>)0(f){d'^(j}d^(j}) recently 
studied in the context of "Galileon" cosmology, which keeps the field equations at second order. 
Taking into account a scalar-field mass explicitly, the equations of matter density perturbations 
and gravitational potentials are obtained under a quasi-static approximation on sub-horizon scales. 
We also derive conditions for the avoidance of ghosts and Laplacian instabilities associated with 
propagation speeds. Our analysis includes most of modified gravity models of dark energy proposed 
in literature and thus it is convenient to test the viability of such models from both theoretical and 
observational points of view. 



I. INTRODUCTION 

The constantly accumulating observational data [iHll have continuously confirmed that the Universe entered the 
phase of accelerated expansion after the matter-dominated epoch. This has motivated the idea that the gravitational 
law in General Relativity (GR) may be modified at cosmological distances to be responsible for the cosmic acceleration 
(see Refs. Q for review). Many dark energy models based on the modification ofgravity were proposed-including 
f{R) gravity [H and generalizations 0, scalar-tensor theory Q, ghost condensation [aQ, the Dvali-Gabadadzc-Porati 
(DGP) brancworld model [l^], and the Galileon model [Tl| . 

The modified gravity models of dark energy need to be constructed in such a way that Newton gravity is recovered 
at short distances for the consistency with solar-system experiments, while the deviation from GR can be allowed at 
large distances. On cosmological scales the effective mass of a scalar-field degree of freedom is required to be very 
small (of the order of the present Hubble constant) for realizing the cosmic acceleration today. Such a small mass 
generally leads to a long range fifth force incompatible with local gravity experiments [l2j . unless some mechanism 
screens the scalar-field interaction with standard matter. 

There arc two known mechanisms that allow a decoupling of the scalar field in local regions. The first is the so-called 
chameleon mechanism [l^ in which the field mass is different depending on the matter density in the surrounding 
environment. If the field is sufficiently heavy in the regions of high density, a spherically symmetric body can have a 
"thin-shcU" around its surface such that the effective coupling between the field and matter is suppressed outside the 
body. In f{R) gravity and scalar-tensor theory, the chameleon mechanism can be at work to avoid the propagation 
of the fifth force even if the bare scalar-field coupling with matter is of the order of unity [T^ - [l9j . In fact, a number 
of authors proposed viable dark energy models based on f{R) and scalar-tensor theories from the requirement that 
the field mass is sufficiently large in the regions of high density fl6l [2 0l -|2^ (see also Refs. [TtI. [25l. [26j ) . 

The second mechanism is the so-called Vainshtcin mechanism [27| in which nonlinear effects of scalar-field self 
interactions lead to the recovery of GR at small distances. In massive gravity where a consistent massive graviton 
is determined by Pauli-Ficrz theory (28| . the linearization close to a point-like mass source breaks down inside the 
so-called Vainshtein radius . One needs to take into account a nonlinear self- interaction for the radius smaller than 
r*. In the DGP braneworld model [l^l the Vainshtein mechanism is also at work through a field self- interaction of 
the form {r'^/rripi) □(/)(c?^09^0), where </> represents a brane-bending mode, Tc is a cross-over scale of the order of the 
Hubble radius H^^ today, and mpi is the Planck mass [29l - [3lj . Nonlinear effects lead to the decoupling of the field 
from matter in the region where the energy density p is much larger than r~'^rn^y 

Although the Vainshtein effect screens the fifth force mediated by the brane-bending mode, the self-accelerating 
cosmological solution in the DGP model is plagued by the appearance of a ghost mode |3ll433| . In order to realize 
self- accelerating solutions without ghosts, the equations of motion should be kept at second order in derivatives. This 
can be addressed by considering higher derivative scalar-field interactions that respect a constant gradient-shift in 
the Minkowski space-time, i.e. d^(j) ^ dfj.4' + H- addition to the term proportional to U(j){d'^(j)d^4>), Nicolis 
et al. [131 derived other higher derivative interactions that keep the equations of motion at second order. This was 
extended to a more generalized covariant Galileon nonminimally coupled to the scalar curvature [35| . 

In the presence of a nonlinear self-interaction of the form ^(0)n0(9^09p0), where ^(0) is a function of a scalar field 
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4>, Silva and Kovama [Sal showed that it is possible to avoid the appearance of a ghost mode in the 4-dimensional 
Brans-Dicke theory |37| . Ahhough such a term does not satisfy the Gahlean invariance in the Friedmann-Lemaitre- 
Robertson- Walker (FLRW) cosmological background, the equations of motion remain at second order. For the choice 
^((/)) cx 0"^ there exists a de Sitter solution responsible for the late-time cosmic acceleration, while the Vainshtein 
mechanism allows to recover the General Relativistic behavior in the asymptotic past [36| . Recently this was extended 
to more general modified gravitational theories in which the late-time de Sitter solution is realized by the field kinetic 
energy p38| . 

In order to confront dark energy models with observations of large-scale structure, cosmic microwave background 
(CMB), and weak lensing, it is important to study the evolution of cosmological perturbations [11]. If the gravity 
is modified from GR, the effective gravitational coupling characterizing the growth rate of matter perturbations is 
subject to change. Hence, in general, modified gravity models leave distinct observational signatures compared to 
models based on GR. In this respect the evolution of matter perturbations has been extensively studied for a number 
of modified gravity models-includiiig_/(^)_gTavity [H 113,1^^, HJ, scalar-tensor theory [H IHHii], the DGP 
model [131, and the Galileon model jSa Esl - lsoj (see also Refs. [51 1). In Ref. [4l| the equation of matter perturbations 
was derived for the general Lagrangian (/))/2 -I- f2{4', X)/2, under the assumption that the mass of the field 

is as light as the Hubble constant Hq today. This assumption can be justified for the field potential having a light 
mass during most of the cosmological epochs. In scalar-tensor models with a coupling of the order of unity between 
the field and matter, the potential needs to be designed to have a large mass in the regions of high density so 



that the chameleon mechanism screens the fifth force [2j|. Cosmologically the transition from the "massive" regime 
to the "massless" regime can occur during the matter era, depending on the wavelength of perturbations (including 
f{R) gravity) [H, [12, [13, . Hence it is important to take into account such a mass term to estimate the epoch of 
transition and the resulting matter power spectrum. 

In this paper we study the evolution of density perturbations for the general action ([T} given below. In addition 
to the effect of the field mass, we discuss the effect of the nonlinear self-interaction £c = £,{4')^4'{d^4'dfi4') on the 
dynamics of perturbations. In other words we consider two effects for the recovery of GR in the past cosmological 
evolution-(i) the chameleon mechanism through the field mass M^, and (ii) the Vainshtein mechanism through the 
self-interaction term Cc- For the theories with / = /i(i?, 0) -I- /2(0, X) plus £c, we shall derive the equation of 
matter perturbations as well gravitational potentials under the quasi-static approximation [4l[ . [42[ . [46l [53 | on sub- 
horizon scales. Since our analysis is sufficiently general, this will be useful to place observational constraints on each 
model. We also derive conditions for the avoidance of ghosts and Laplacian instabilities, without recourse to any 
approximation. This is required for the construction of viable dark energy models free from theoretical inconsistency. 

II. PERTURBATION EQUATION IN GENERAL MODIFIED GRAVITATIONAL THEORIES 

We start with the following 4-dimensional action 

5 = Jd^xV^ i/(i?,(/.,X)+e(0)n<^(a^0a^(/)) + J d^x£,n{9f..,'^rn), (1) 

where g is the determinant of the metric g^,^, / is a function in terms of the Ricci scalar R, a scalar field 4> a-nd a 
kinetic term X = —g^'^df^4>d^4>/2, and ^(0) is a function of cj). Cm is a matter Lagrangian that depends on the metric 
(7^1, and matter fields ^I^m . If ^((/>) is constant, then this term respects the Galilean symmetry — >■ df^(j) + as well 
as the shift symmetry + c in the Minkowski space-time [13, [H, \^ . Here we consider a general function ^ {(f>) 
in terms of (Las this allows the possibility to give rise to the late-time cosmic acceleration without the appearance of 
a ghost [3i,|4i|. 

Varying the action ([!]) with respect to 17^1/ and 0, we obtain the following field equations 

FG^, ^lif- RF)g^, + V^V.F - g^^UF + i/,.YV^0V,0 + T^^' + T^™) , (2) 
(/,xV^0) + = t(^) , (3) 

where F = df/dR, /_x = df/dX, f^^f, = df/d(f>, T^T^ = —{2/^/^)SCm/Sg^'^ is the energy-momentum tensor of 
matter, and 

= 2 (^9V5a0) ^ (^0,.) - 2en</.(9^09.</.) - d^{(dP(j>dp(j>)d^^ g^, , (4) 

r('=) = -2 [i^D^{d''<f>d^(f>) + □ i^d^^^d^^) - 2v^ (e □(/) . (5) 
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We consider the following perturbed metric about a spatially flat FLRW cosmological background with scalar metric 
perturbations ^ and $ in a longitudinal gauge [53| : 



ds^ = -(1 + 2^)dt^ + ait)^{l - 2^)Sijdx'dx^ , 



(6) 



where a(t) is a scale factor with cosmic time t. We caution that our notations of ^ and $ are opposite to those used 
in Ref. [4l|. We decompose the field (j) into the background and inhomogeneous parts: (j){t, x) = 4>{t) + x). We 
consider a perfect fluid for the energy- momentum tensors T^™\ so that they can be decomposed as Tq = —{p + 5p), 
T°^"^ = -{p + P)u,„, and T^^'"' = (P + (5P)(5^ (where d is a velocity potential). We also decompose T^5:' and T^"'^ 

into the background and perturbative parts, as tI^J = f^fj + ST^^;) and T^^) = f(=) + 5T^''\ In the following, when 
we express background quantities, we drop the tilde for simplicity. 
In the flat FLRW background we obtain the following equations 



f,xX + -{FR-f)- 3HF + i6HC ~ U 



2FH =-{FR- f)-F- 2HF + 0^(2^0 + ^,00") - P, 



3FH^ 
3FH^ 

lx4> + (iHf^x + ix) - /,0 + t'^"^ = , 

p + m{p + p)^{), 

where a dot represents a derivative with respect to and 

H = a/a, R = 6{2H'^ + H), 

T(^) = -2(/. [(/.(4e00 + ^,00(/)') - 6e [2H4> + (SH^ + H^'j . 
We also obtain the following linearized equations for the perturbed metric (jB]) in the Fourier space^: 



(7) 

(8) 

(9) 
(10) 

(11) 
(12) 



h2 1 

3H{^ + H^) + — $ + — 



1 • 



-T^if.^S^ + f.xSX) + -cj3\f^xM + f,xx5X + F^xSR) + f^xcf>S(f> - 3HSF 



3H 



2 ' 3H-^]SF + 3P($ + H^) + (3HF - f x<P^)'i' - ST^'^"^ + 5p 



,x 



3H 



J,x 
f,x 



0(3$ + *) 



2/,0* + ^(a' 



X 



= 0. 



5p + 3H {5p + 5P) = (p + P) ( 3$ 



1 



a?{p + P) dt 



[a3(p + P)i.] = 



SP 
p + P 



(13) 

(14) 

(15) 
(16) 
(17) 



^ We checked that ST^^"^^ and 5T('^' in Eqs. 1 II8II and II19I I coincide with those given in Ref. [sSl . However there are some differences in 
Eqs. {TSj and QiJ compared to Ref. [H]. We do not have the term ((5F/F)T^*''' in Eq. ^ and we have the term 2'I'T('=) in Eq. ITU . 
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where fc is a comoving wavenumber, and 



o(=) 



6t; 



2($ + + + + ij* + i?*) 



9i2H4> + 2H^<j> + H(j>) 



fc2 



We introduce the gauge- invariant matter density perturbation S„i, as 



+ 3H{l + w)v, 



where w = P/p. 



(18) 



(19) 



(20) 



III. QUASI-STATIC APPROXIMATION FOR PERTURBATIONS OF NON-RELATIVISTIC MATTER 

The action ^ covers a wide variety of dark energy theories such as f{R) gravity Brans-Dicke theory (37| . 
scalar-tensor theory 0, and k-essence [5^ (ghost condensate, tachyon, Dirac-Born-Infeld models, etc). Most of those 
theories take the Lagrangian of the form 



/(i?,0,X) = /i(i?,0)+/2(0,X) 



In this case the quantity 



F 



df _ dhjR,, 
OR 



dR 



(21) 



(22) 



is a function of R and (f>. Note that the Lagrangian (pi]) does not include theories in which the kinetic term X couples 
to the Ricci scalar R. 



In Ref. [41| the perturbation equation for non-relativistic matter has been derived for the Lagrangian (j2ip with 
£,{</>) ~ 0, under the assumption that the effective mass of the field cj) is smaller than the Hubble expansion rate H. 
In this work wc shall take into account the effective mass of the field by defining 



Mi 



(23) 



For a minimally coupled scalar field with the Lagrangian / = R/{8ttG) + 2X — 2V{(t)), we have that Af| = V^^. The 
quantity does not in general correspond to the mass of the propagating canonical field. 

For the perfect fiuid let us consider non-relativistic matter {w = 0). Combining Eqs. and P7)) . the gauge- 
invariant matter perturbation Sm = Sp/p + 3Hv satisfies 



2HS,n + = 3B + 6HB , 



(24) 



where B = ^ + Hv. The modes relevant to the observations of large-scale structure correspond to the sub- horizon 
perturbations (fc 3> aH). In order to derive the equation of matter perturbations approximately, we use the quasi- 
static approximation under which the dominant terms in Eqs. (|13p . (|14l) . and (|24p are those including fc^/a^, 5p (or 



5m), and M? [4l|, |42, |46fc |5^] ■ As long as the oscillating mode of a scalar- field degree of freedom is suppressed relative 
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to the mode induced by matter perturbations, this approximation is vahd for sub-horizon perturbations |20l . |22| . \24 
First of aU, the perturbation in the Ricci scalar is given by 



5R ^ 2 



- 3i/ - 2—$ - 3(<I> + 4i7$ + Hi' + H'ii + AH"^^) 



i,2 

~ 2 — (*-2$). 
From Eqs. (HH]) and (US]) it follows that 



6R'. 



2P ^ + {2F^/F)5cf> 

^2 ]^ 



where 



ri 



a? F 



3a2 Ml 



(25) 



(26) 



(27) 



Here M| = F/(3Ffl) is the mass squared of a scalar-field degree of freedom coming from the curvature term [3, [2C 
(which is valid in the region M| ^ iJ^). 

For the theory (I^TI) the perturbation (5/ is given by 



where 5X 



Sf = F5R + f^4,S<P + h.x5X , 
0^^'. Under the quasi-static approximation we have 

(5/,^~F^Ji?-2A/250. 

From Eq. pi)) we find 



/r2 



F^^SR + 2Mlt 



where 



2H(t>)5(l) + (t>'^^ 



(28) 
(29) 

(30) 

(31) 



Here we have neglected the oscillating mode of the field perturbation 5(t>. If the field is sufficiently heavy in the regions 
of high density, such an oscillating mode can be important as we go back to the past ^0, 22, 56] . The initial conditions 
for the field perturbation need to be chosen so that the oscillating mode is suppressed relative to the matter-induced 
mode. 

Prom Eqs. ^ and it follows that 



2F^ + 4^02(1 ^4^^) 



5R 



(1 + 4ri)[/.x + 2r2 + 8^(0 + 2H<P)] + ^F^/F 
2P f^x + 2r2 + 8^{^ + 2H<j) - ^^F^/f ) 

(1 + 4ri)[/,A- + 2r2 + 8^(0 + 2H^)] + 4FI/F 



(32) 
(33) 



where 



r2 



(34) 



From Eq. (|13p one has 



which, together with Ec^. ([T5|) . gives 



a2 



^(%5F-5p~2^4>^'- 
2F \ "■^ 



* 9 



'a2 



(35) 



(36) 
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Plugging Eqs. ^ and ^ into Eq. ([36]), we obtain 

^ ^5p_ (1 + 4ri)(/,x + 2r2) + AF^^/F + 8^(1 + 4n){4> + 2H^) 



2F (1 + 3ri)(/,x + 2r2) + Si^^ /F + 2e[4(l + 3n){c^ + 2H<P) - 2F^^^^/F - 2^04(1 + 4ri)/F] 

fc^^ _ (1 + 2ri)(/,x + 2r2) + 2F%/F + 4e[2(l + 2ri)(<j^ + 2g./>) - f ^^Vf ] 

a? ~ 2F (1 + 3ri)(/,x + 2r2) + 3^^2 /F + 2e[4(l + 3ri)(0 + 2i?0) - 2F^^yF - 2^04(1 + 4n)/F] 



Under the quasi-static approximation on sub-horizon scales the r.h.s. of Eq. ([24| can be neglected relative to the l.h.s. 
of it. Moreover the gauge-invariant matter perturbation can be approximated as S„i ~ Sp/ p. Then, from Eqs. (|24p 
and (|37p. wc finally obtain 



<5™ + 2H6,n - 4^Geff p <5™ ~ . (39) 
Here the effective gravitational coupling is given by 



a2i2 



87rFl-f3ri[ (l-F4ri)/iF J' ^ ' 

where 

= (1 + 3ri)(/,x + 2r2) + 3F^^/F + 2C[4(1 + 3ri)(0 + 2H<P) - 2F^4>yF - 2^<j)\l + 4ri)/F] . (41) 
We define the following quantity 

C^^-/*. (42) 

From Eqs. dST]) and ((SH]) it follows that 



_ (1 + 4ri)(/,x + 2r2) + 4f + 8^(1 + 4ri)(0 + 2H<P) 

" (1 + 2ri)(/,x + 2r2) + 2F^^/F + 4^(2(1 + 2n){4> + 2H4>) - ' 

We also introduce the effective gravitational potential 

$eff = (1- + $)/2 . (44) 

This quantity characterizes the deviation of light rays, which is linked with the Integrated Sachs- Wolfe (ISW) effect 
in CMB and weak lensing observations [s^]. From Eqs. ([57)1 and psp we have 

$ (l + 3ri)[/,;, + 2r2+8e(9^ + 2g0)]+3fyf -2ef00Vf 

2F P(l + 3ri)[/,x + 2r2 + 8e(<^ + 2i/0)]+3Fy^^-4C[F^02/^^ + e04(l+4ri)/F] ■ 

Note that for the theories with ^ = this reduces to 

- 2F k^- ^ ' 

The presence of the ^ term leads to the modification to the effective gravitational potential and hence this can leave 
some nontrivial signature on the CMB spectrum [s^, |4^ . 



IV. EVOLUTION OF PERTURBATIONS IN SPECIFIC THEORIES 



In this section wc apply the results in the previous section to a number of concrete modified gravitational theories. 
It is convenient to write the matter perturbation equation p9p in the form 

C + Q - l^cs^ - {l2^FG,s)^m5m ^ , (47) 
where a prime represents a derivative with respect to = Ina, and 

-e.^-l-|^, (48) 
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A. f{R) gravity with ^ = 

Let us consider the theories with the Lagrangian 

/(i?,^,X) = /i(i?) + /2(0,X), (49) 
which inchidcs f{R) gravity as a specific case. When ^ ~ 0, Eqs. (fST]) . (|38|) . (|40|) . and (j43|) give 

a2 2F 1 + 3ri ' 2F 1 + 3ri ' SttF 1 + 3ri ' ^ 1 + 2ri ' ^ ^ 

where $off is given in Eq. P5|) . This matches with the results obtained in Refs. [4l|, [sll in the context of /(i?) gravity. 
Even in the presence of a scalar field minimally coupled to gravity, the above results are the same as those in f{R) 
gravity. 

In the regime where the mass squared Af|. of the scalar- field degree of freedom (scalaron [H^) is much larger than 
fc^/a^, i.e. ri <C 1, the evolution of perturbations during the matter dominance (a cx t^/^, WcS — 0, and flm ~ 1) is 
given by Sm oc t^^^, $cff ~ constant, and C ~ 1. In the regime <C k'^/a?. the perturbations during the matter era 
evolve as 0, ill 

5„(xt(^-i)/6, <I>eff (X C^2. (51) 

After the perturbations enter the epoch of cosmic acceleration, the evolution ([5T|l is subject to change. 



B. Scalar-tensor theories with ^ = 

Let us consider scalar-tensor theories with ^ = in which the function /i in the Lagrangian (j2ip depends on both 
R and (f). This covers the theories with the effective two-scalar degrees of freedom, i.e. scalaron (the gravitational 
scalar) and the field 0. The scalar-tensor theory with / = F{(j))R + f2{(t>,X) has one scalar degree of freedom, but 
the nonlinear action in R gives rise to another gravitational scalar degree of freedom. From Eqs. ([57)) . ([55)1 . pOj) . and 
(|43)) . it follows that 

P _ 5p {l + ^n){lx + 2r2) + AFl/F _ 6p {I + 2n){lx + ^r.J + 2Fl/ F 



a 



2 2^^(l + 3ri)(/,x + 2r2) + 3FyF' 2F {I + 3n){f^x + 2r2) + SF^/F 



1 l + 4n+Fl/{pF) {l + An){lx + 2r2)+iFl/F 

^''''^SttF l + 3ri ' il + 2n){lx + 2r2) + 2F-^/F' ^^^> 

where /i = (1 + 3ri)(/.x + 2r2) + 3F^^/F. These correspond to the generalization of the results obtained in Ref. [4l| 
with the mass term taken into account (r2 ^ 0). 

There are three different regimes depending on the values of ri and r2- 

• (i) ri < 1 and > F^^/F 

This corresponds to the regime in which both the scalaron and the field (f> are sufRciently heavy. The evolution 
of cosmological perturbations mimics that of GR. 

• (ii) ri < 1 and r2 < 

In this regime the scalaron is sufficiently heavy, whereas the field is light such that it gives rise to the 
modification of gravity. In fact we have 

P 5p f.x+^F%/F fc2 _5^f^x + 2Fl/F_ 1 f^x+^F^/F f.x+4F^^/F 

a2 - 2F/,x+3FyF' a'- ~ 2Ff,x + 3Fl/F' " /,x + 3Fyi^ ' ^ /,x + 2FyF ' 

_ ' ' (53) 

Let us consider Brans-Dicke (BD) theory [33] with the field potential, i.e. 

f=^R+^-^X-2V{<^), (54) 
K n(p 
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where wbd is the BD parameter, and k = 1/Mpi (Mpi is the reduced Planck mass). It then follows that 



fc\ ^p 2a;BD+4 ^ _ 5p_2uj^o±2_ ^ 1 2cjbd + 4 wbd_+2 

o2 ~ 2F 2wbd + 3 ' a2 ~ 2i^ 2wbd + 3 ' ~ 8ttF 2wbd + 3 ' ~ wbd + 1 



The no ghost condition in BD theory corresponds to ojbd > —3/2, in which case the gravitational coupling GcS 
is positive. The evolution of perturbations during the matter-dominated epoch is given by 



l( / 99 + 50a,BD \ 1/ / 99 + 50^BD A 



(56) 



Compared to GR (cjbd — > oo), the growth rate of perturbations is enhanced for the theories with cjbd > —3/2. 
We have ^ > 1 for cjbd > —1 and C < — 1 for —3/2 < cjbd < — 1- 

• (iii) ri > 1 

This is the regime in which the scalaron has a light mass. Irrespective of the values of r2 one has 

Ge.^^-^, C = 2, (57) 
a2 2F 3 a2 2F 3 SttF 3 ' ^ ' ^ ^ 

which correspond to the massless regime ri ^ 1 in f{R) gravity. 

We can consider models in which the sequence of three cosmological epochs (i) (ii) (iii) occurs. If this occurs 
during the matter era, the matter perturbation starts to evolve as Sm oc t^^^ in the region (i) and its evolution is 
followed by ([5S|) [region (ii)] and ([5T|) [region (iii)]. In this case the variable ( evolves as 1 — >■ {ojbu + 2)/(wbd + 1) — > 
2. If the perturbations reach the regime ri > 1 before entering the regime r2 < F'^^/F, then there is no intermediate 
regime (ii) characterized by Eq. (j53p . 



C. Brans-Dicke theory with ^ 7^ 



Let us consider BD theory with a potential described by the Lagrangian in the presence of the field self- 
interaction ^{(t>)D(t){^^'<j)^^,(j)). From Eqs. §8^, dM]), g^, and (gH), it follows that 



k'^ kSo 

V]/ ~ — 

fc2 



2tjBD +4-1- 2r2K(f> + 8Ck0(0 + 2H(j)) 



Goff 



20 2wBD + 3 + 2r2K(j} + 8^K(j){4> + 2H^) - 4^^(02 + ^k^") ' 
nSp 2a;BD + 2 + 2r2K0 + 8^K(/i(0 + 2i?(/)) - 4$k02 
20 2a;BD + 3 + 2r2K(/) 8^/v0(0 + 2H4>) - 4^^(02 ^«;04) ' 



(1 + 2iKdJ ^f 



2wBD + 4 2r2K0 + S^K. 



2H0) 



2a;BD + 2 + 2r2K0 + 8^k0(0 + 2i70) - 4Ck02 



'20P " 



2wbd + 3 2r2K(/) + 8^k0(0 -|- 2i70) - 2^k(/)2 
2wBD + 3 + 2r2K0 + 8CAt0(0 + 2H^) - 4^k(02 -t- ^k04) 



where 



«;0/i = 2ajBD + 3 + 2r2n4> + 2^k 



27?(/)) - 202 - 2^K0''] . 



(58) 
(59) 
(60) 
(61) 
(62) 

(63) 



For the special case with 7-2 = and ^(0) = l/{M(jP) {M is a constant having a dimension of mass), the effective 
gravitational coupling (|60p agrees with the one derived in Ref. [s^ . 

In the presence of the field potential V {(/>), one can recover the results in GR by taking the massive limit r2K0 — > 00 
in Eqs. (|58p - (p^ . There is another mechanism called the Vainshtein mechanism [27[ for the recovery of GR in the 
high-curvature regime (i.e. during radiation and deep matter eras). This is the case in which the term 8^k0(0 -I- 2iJ 0) 
is the dominant contributions in Eqs. ([55|) - (p^ . In fact this situation arises for the function ^(0) responsible for the 
late-time cosmic acceleration. For the choice ^(0) = 1/(M02), provided wbd < —2, there is a stable de Sitter solution 
with H = and x = 4>/ {,H(f>) ~ constant even in the absence of the field potential (r2 = 0) [36l[38|. 
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For the choice ^ = 1/(M0^), one has + 2H(j)) » 1 and a; s <j)/{H<l)) ^ 1 in the early cosmological epoch 

[36| . During the matter era, for example, we have that ^KH(j)(j> = kH^x/M ~ l/{6x) ^ 1, where we have used 
y = kH^x^/M ~ 1/6 nil. In this regime the perturbation equations ([58 l) - (|62)) recover the results in GR. At late times 
the deviation from GR arises, so that the evolution of perturbations is subject to change. As we will see later, the 
avoidance for the appearance of ghosts demands the condition x > 0. Under this condition the /t^/x term defined in 
Eq. can remain to be positive [s^ . Hence the growth rate of matter perturbations gets larger than that in GR, 
unlike the DGP model [l^l- We also note that the presence of the nonlinear self-interaction gives rise to a nontrivial 
contribution to <l>off because the last fraction in Eq. is different from 1. 

The presence of the field potential V{(l)) (i.e. r2 ^ 0) gives rise to the change for the evolution of perturbations. 
One may consider theories in which the field is heavy {r2K(j) 3> 1) in the early cosmological epoch, but the presence of 
the nonlinear self-interaction leads to the recovery of GR instead of the chameleon mechanism based on a heavy scalar 
field. More specifically this corresponds to the condition £,K(p{(j) + 2H(j)) ^ r2K0 ^ 1. Depending on the evolution of 
the terms ^K(j){(j) + 2H(j)) and r2K(f>, the perturbations evolve differently at late times. 

For more general theories with the Lagrangian / = F{(f))R + 2Lo{(f)X — 2V{<t)) (i.e. ri = 0) the cosmological 
Vainshtein mechanism mentioned above can be also at work, provided that the ^{(j) + 2H(j}) term is the dominant 
contributions in Eqs. ((23), (gO]), (US]), and (gS]). 



V. CONDITIONS FOR THE AVOIDANCE OF GHOSTS AND INSTABILITIES 



In this section, we study the full Lagrangian perturbed at second order without using any approximation to derive 
conditions for the avoidance of ghosts and Laplacian instabilities. Let us consider the following general action 



5 = / d^xy/—g 



\.f{R, 0, X) + e(0)n<^(a^ 09^.0) + P{z) 



(64) 



where P{Z) models the Lagrangian for the matter fluid x with the following parameterized equation of state 

p^2ZP'{Z) - P{Z), P^P{Z). (65) 
Here a prime represents a derivative with respect to Z . The sound speed squared of this fluid is [60l | 



2ZP"{Z)+P'{Z) 



(66) 



As long as scalar and tensor perturbations are concerned, the above k-essence description of the matter flcld x is 
equivalent to the description for the barotropic fluid. 

For this action we generally have three propagating scalar degrees of freedom, one from gravity, one from the flcld 
(/), and one from the matter fluid. The action (j64p can be written as 



S 



d^T^ 



i(i? - x)F + i/(A, X) + a<j>)n<i>{d^c^d,,<i>) + p{z) 



where the equations of motion for the auxiliary flclds lead to 



A = i?, 



F = 



dl 



(67) 



(68) 



Variation of the action (|67|) leads to the same equations of motion as those derived by varying the action ([64|) . Note 
that F in general depends not only on A = i? but also on and X. One example of theories with F^x ^ is 
/ = Ml^R + ai?2 + A/(i?VM4 )™ - V{<p) with m > 3/2 l6l|. 

Formally, the auxiliary flcld A can be eliminated by solving its equation of motion F — df/dX. In practice, this 
procedure can be done at each order in perturbative expansion. At the linear order we have 



SX 



SF - f^R^6<j) - f,Rx6X 

f,RR 



(69) 



provided that J^br ^ 0. Using this relation to eliminate SX at the level of the action only makes sense when J^rr ^ 0. 
In subsection IV Ai we shall consider theories with J^rr ^ 0. 
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The case with /,_r_r = has measure zero in the space of theories. Indeed, adding e.g., aR^ with an extremely small 
a to / would make /^rr non- vanishing. Therefore, physically speaking, it is not really necessary to study theories 
with strictly vanishing /^rr. Nonetheless, in subsection IV Bl we shall consider the case with /^rr — f,Rx = as a 
simple example of theories with /^rr = 0. The case with f_RR, = and f_RX 7^ is not only physically irrelevant 
(having measure zero in the space of theories) but also technically complicated. Thus, we shall not address this case 
in the present paper. 



A. Case (i): / 



We consider the flat FLRW background plus scalar-type perturbations a, /3, TZ, and E: 

ds^ = -(1 + 2a)df + 2a(t)2^,,dMx' + a{t)^ [(1 - 27^)% + 2E^,j] dx'dx^ 



(70) 



By using the Faddecv-Jackiw method |62| . we can calculate the reduced quadratic action for gauge- invariant pertur- 
bations (see also Refs. [63]). Since the perturbed Hamiltonian and momentum constraints are of the form 



= 
= 



da 
dp 



-Hlin + 4>Ii-S4, + FIVsF + X^sx + hi (U, Scj), SF, Sx, E) , 
IiE + h2{n,6^,5F,5x,E), 



(71) 



where "H*-^^ is the quadratic Hamiltonian density and IV'fi,S(j,,5F,5x.E arc momenta conjugate to TZ, S<f), 5F, Sx, E respec- 
tively, we can solve them with respect to Tlg-^ and He- 

Noting that the constraints are generators of gauge transformation, the form of the constraints enables us to identify 
the three gauge-invariant variables as 



H X 4> X Fx 

By substituting the solutions of the Hamiltonian and momentum constraints to the quadratic action 



5(2) 



^7^7^ + ns4,d^ + UsfSF + Us^Sx + ^eSE - 7^(2) 



(72) 



(73) 



we obtain the reduced quadratic action written in terms of the gauge- invariant variables Qi (i = 1,2,3) and their 
conjugate momenta Hq. only. After using the equations of motion for the conjugate momenta to express them in 
terms of Qi and Qi, the reduced quadratic action is expressed in terms of Qi and Qi as 



Q'KQ - ^VQ*GVQ - Q^BQ - Q'MQ 



(74) 



where K, G, B and M are 3x3 matrices. 



1. No ghost conditions 

The three eigenvalues Ki {i = 1, 2, 3) of the kinetic term matrix K arc all positive if and only if the following three 
combinations are positive. 

K1K2K3 = aiB/D, 
K1K2+K2K3 + K3K1 = (aaS + as)/!?, 

K1 + K2 + K3 ^ {a4B + a5)/D, (75) 
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where 

B = 24^H^-8i^.j>^ + f^x + f.xx'p'' ~ F%,j>yFR, 
D = {F + 2HF -2£,4)^f , 
ai = 3{p + P)c-^H^^F^F, 

a2 [{F^ +4:H^F^){p + P)cJ^ + mH^F^F]^^/2, 
^3 = 6{F^+4e<}>^){p + P)c7^H'F, 
ai = [{F + HF)^ +3H^F^]^'' , 

as = {F^+m^F^+4f^^){p + P)c-'^ + l2[{F~^(})^f + 3^^(l)^]H^F, (76) 

and F = J^r. 

We assume that F > Q since this is required for the absence of tensor ghosts. Let us also suppose that (p + P)c7^ = 
2{2ZP" + P')Z > 0, which is required for the absence of ghosts in the matter sector. Under these assumptions, D 
and ai (i = 1, • • • ,5) are non- negative, and there are no ghosts in the scalar sector if and only if _B > 0, i.e. 

24^i70 - 8^,00' + f,x + f^xx<j>^ - F^x'PVFr > ■ (77) 



2. Avoidance of Laplacian instabilities 

For large k the dispersion relation is specified by 

dct{oj^K - k^G/a^) = . (78) 

This is equivalent to 

det{c^K -G)=Q, (79) 

where c is the speed of propagation defined by 

oj' = c'^. (80) 

More explicitly we have 

det(c2K -G) = 3{p + P)BH^4PF^F{c^ - c^) [c^ - (c? + c^^)c^ + c^c^] /D , (81) 

where 

cl+cl^l + ae/B , cjc^ = (ag - 07)/^ , (82) 

and 

ae = /,A- + 8(0 + 2i/,^)e , aj ^ l&e i^F) . (83) 

Gradient instabilities are avoided if and only if c^, c\ + c|, c^Cj and {c\ — c^)^ are all non-negative, where 

{cl-clf = {l-a^/Bf +AaT/B. (84) 

Under the conditions F > (absence of tensor ghosts) and B > Q (absence of scalar ghosts), the condition for the 
absence of gradient instabilities is equivalent to ag > ar, i.e. 

/,A- + + 2i/0)e - 16^2^V(3^^) > . (85) 
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3. Mass of propagating modes 

We provide here a straightforward procedure on how to define the mass for the propagating modes. For the reduced 
action (|74p . we can first diagonahze and normahze the kinetic matrix K to the identity matrix, through a convenient 
hnear field redefinition Q = AQ! . Each field redefinition, in the fc — > limit, will contribute to the matrices B 
and Af, as A is time-dependent and the modes feel the time evolution of the background. Having the canonically 
normalized kinetic matrix, we can perform a rotation Q! = RQ" , which transforms the mass matrix into 



M" = M' +T^- {B'T + TB')I2 , 



(86) 



where T = R}R is antisymmetric. Then the mass eigenvalues are obtained by choosing the elements of T which 
diagonahze M" . This procedure implies solving a differential equation for the elements of T and T. We shall not 
present explicit expressions as they are rather complicated. 

4- Specific theories 

Let US apply the above results to the relaxation mechanism of the cosmological constant [6l|. In the simplest case 
the Lagrangian is specified as 



with m > 3/2. It is straightforward to show that 



4m2(i?2/M4)'"-i 



where 



is the momentum conjugate to (j) and 



Fh = 2a + m{2m + l)(i?2/A/4 _ 



The attractor behavior 



(87) 



(89) 



(90) 



(91) 



and R ~ imply that 



{R^/M^,r~'^ ^ (F/Mpi)'^''"-^) ^0 (as i? ^ 0) 



pi 

under the assumption m > 3/2. Therefore, at low energy, we have 

1 



2a, B ' 



> 0. 



This shows the abscnsc of ghost. Gradient instability is also absent as 

1 



"6 f.X (^2/^^4)r 



> , ay = . 



(92) 



(93) 



(94) 



Indeed, the two speeds of propagation ci and C2 are both unity in the low-energy regime. 



13 



B. Case (ii): /mr^ = .f,Rx = 

111 this subsection we consider the case with /,_r_r ~ f,RX = as a simple example of theories with /^rr = 0. As 
already stated, theories with f^RR = have measure zero in the space of theories in the sense that they can easily be 
transformed to theories with f,RR 7^ by inclusion of an additional term like aR^ with small a to /. 

The theories with J.rr. ~ I,RX = correspond to / — F{(t))R + f2{X,4>). One example of the theories with 
f,RR = f,RX = and /xjf b is / = F(<?!))i? - 2X + 2X'^/M'^. Since 5F = F^S(j), the two fields Qi and Q2 are 
sufficient to study the perturbed action. Although this fact simplifies the problem, the nonminimal coupling to R 
directly affects the propagation properties of the field S(j). 

Since SF = F^^Scf), we consider the original action ((64|) instead of the equivalent action (|67l) . Specializing to the 
present case, we have 



S ■ 



d^.T\/— g 



^F{cP)R + 1/2(0, X) + acl>)md^<Pd^^) + PiZ) 



(95) 



By using the Faddeev-Jackiw method [62[, we can calculate the reduced quadratic action for two gauge-invariant 
variables. The perturbed Hamiltonian and momentum constraints are of the form 



= 
= 



da 

dp 



= -Hlln + 0n50 + xn^x + hi (7^, 54), 6x, E) , 
= ^£ + /^2(7^,(50, 5x.E). 



(96) 



As in the previous case, we can solve them with respect to II^-^ and II^;. The form of the constraints enables us to 
identify the two gauge-invariant variables as 



O - ^ + '^^ 
H X 



^ _ S(f) Sx 

^2 = ^ ^ ■ 

X 



(97) 



By substituting the solutions of the Hamiltonian and momentum constraints to the quadratic action and expressing 
the conjugate momenta in terms of Qi and Qi, we obtain the reduced quadratic action of the form. 



1 



Q'KQ - —VQ'GVQ ~ Q'BQ - Q'MQ 



(98) 



where K, G, B and M are now 2x2 matrices. 



No ghost conditions 



The two eigenvalues Ki [i 
combinations are positive: 



1,2) of the kinetic term matrix K are all positive if and only if the following two 



where 



B 

b 

OL2 

"3 



K1K2 = <5iB/D, 
Ki + K2 = {a2B + as)/-/) , 

= (24eH0-8e^02^/,x + /xx0')i^0' 
= {F + 2HF -2C4^ f , 
= 2{p + P)c-^H^F, 
= AH'^F 

= [AF^H^ + {F ~2^4:^f]{p + P)c^^ . 



(99) 



3(F - 2^4-r , 



(100) 



The absence of ghosts for tensor perturbations demands the condition F > 0. The absence of ghosts in the 
matter sector requires that (p -I- P)cj'^ = 2{2ZP" + P')Z > 0. Under these assumptions, D and ai [i — 1,2,3) are 
non-negative, and there are no ghosts in the scalar sector if and only if S > 0, i.e. 



{2A^H(j) - 8^,0^ + f,x + f,xxr)F4' + 3{F ~ 2^0^)^ > 



(101) 
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2. Avoidance of Laplacian instabilities 
For large k the dispersion relation is given by 

dct(c2K - G) = , (102) 

where c is the speed of propagation defined by = (? k'^ /a? . 

There are two solutions to this equation: one is = and another is 

„2_ [/2,x + 8e(?i + 2H0)]F(/.2 + (3F + 2e(^3)(^_2^^3) ^^^^^ 



Under the no ghost condition (|10ip . the condition for the absence of gradient instabilities corresponds to 

[/2,x + 8^(0 + 2H4>)]F^^ + (3F + 2^^^){F - 2^4>^) > . (104) 

3. Specific theories 

Let us apply the above results to generalized Brans-Dicke theories recently proposed in Ref. [s^. These theories 
are given by 

F(0) = , /2((/.,X) = 2c.(^0)i-"X, m=M^-'r", (105) 

which can be obtained by demanding the existence of de Sitter solutions responsible for dark energy. The Brans-Dicke 
theory with ^(0) = 1/(M02) [s^ corresponds to the choice n = 2. The viable model parameter space is restricted in 
the regions 2 < n < 3 and u> < —n{n — 3)^ [s^. 

For this theory the no ghost condition (|10ip reduces to 

B = {FHfx [2Ay + x {2uj + 8ny + 3(3 - n - 2y)^}] > , (106) 

where x = (j)/{H(l>) and y = x"^ AV-^^ / k}^"^ > 0. During the radiation and deep matter eras one has x <^ y for 
the theories with 2 < n < 3. Since B ~ 2A{F H)^ xy in this regime, we require that x > to avoid the appearance of 
ghosts. The sign change of x leads to the violation of the condition (|106p and hence the condition x > is required 



during the cosmological evolution from the radiation era to the de Sitter epoch [38 1. 

Let us consider the evolution of the propagation speed ()103p during the radiation and matter eras for 2 < n < 3. In 
this regime the dominant terms in the numerator and the denominator of Eq. (|103p correspond to 8^(0 + 2H(t))F(j)'^ 
and 24:(_HF(j)^, respectively. This gives 

c^-l + i. (107) 

From Eqs. ([8]) and ([9|) we also obtain the following approximate relation 

4if^# + 2^{3H^ + ff)(/)2 - F^^(2H^ + i7) ~ . (108) 

As long as the field energy density is suppressed relative to the radiation and matter densities we have H/H^ ~ 
— 2 + rim/2, where 17,„ = p„i/{3FH^) is the density parameter of matter. Plugging Eq. (|108p into Eq. (|107p . it follows 
that 

1 3 — n 

c2 ~ — (6-an) + ^^an. (109) 

Since y ~ (3 — n)57,„/8 during the radiation era [s^, one has ~ 5/6 — ilm/12. Meanwhile y~ (3 — n)/6 during the 
matter era (r2,„ ~ 1), so that ~ 2/3. These results agree with those obtained in Refs. [3^, [331- At the de Sitter 
point one has < < 1 as long as .t > and n> 2 (ssj . 
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VI. CONCLUSIONS 

We have discussed cosmological perturbations for the general Lagrangian f{R,(j),X)/2 + £^{(j))D(j){d^(j)d^(j)), which 
includes most of modified gravity theories proposed in literature. The presence of the nonlinear field self-interaction 
term allows a possibility for the recovery of GR in the early cosmological epoch, even if the field potential is absent. 
We also take into account the effect of the field potential to cover the case in which the transition from the "massive" 
(GR) regime to the "massless" (scalar-tensor) regime occurs during the cosmological evolution by today. 

Under the quasi-static approximation on sub-horizon scales we have derived the equations for the matter perturba- 
tion S,n and gravitational potentials '3/ and $ for the theories / = /i(i?,0) -I- f2{(j),X), see Eqs. ([57)) -(PT |) . There are 
two important mass scales given by = f ^r/ {if ^rr) and M| = —J^^^jl^ which come from the gravitational scalar 
degree of freedom and the field ^ respectively. As long as both scalars are massive such that {M^, M|} ^ fc^/a^, the 
perturbations arc in the GR regime characterized by (S„i cx t^l''^ and $off = (^' + $)/2 = constant during the matter- 
dominated epoch. The evolution of perturbations is subject to change in the regime 
The epoch at which the transition to the massless regime occurs depends on the models of dark energy. 

In Scc. lIVI we have applied the results derived under the quasi-static approximation to a number of modified gravity 
theories and estimated the growth rate of perturbations. Not only with massive fields satisfying the conditions 
{Af|, M|} > k'^ja^ but also in the presence of the nonlinear field self-interaction, the evolution of perturbations 
mimics that in GR during the early cosmological evolution. We showed that our results recover those obtained in 
Brans-Dicke theory with V{<1>) = and ^((/)) = 1/(M0^) [s^, as a special case. 

In Sec. |V] we have derived the conditions for the avoidance of ghosts and Laplacian instabilities by deriving the 
full second-order action without using any approximation. We have discussed two classes of theories: (i) ^rr ^ 
and (ii) f^RR = J^rx = 0. The case (i) corresponds to theories with three scalar-field degrees of freedom, whereas 
in the case (ii) two scalar-field degrees of freedom are present. In the case (i) the conditions for the avoidance of 
ghosts and Laplacian instabilities are given by Eqs. ([77]) and (|55|) respectively, whereas in the case (ii) they are given 
by Eqs. (jlOip and (|104p respectively. We have also shown that in generalized Brans-Dicke theories described by the 
functions (jlOSp our results reproduce the no ghost condition as well as the propagation speed derived in Ref. j38| . 

It will be of interest to apply our results to the construction of viable modified gravity models of dark energy. In 
particular the gencricity of the cosmological Vainshtcin mechanism due to the scalar-field sclf-intcraction should be 
explored further, together with local gravity constraints. The evolution of matter perturbations as well as gravitational 
potentials can be used to place constraints on modified gravity models from the observations of large-scale structure, 
CMB, and weak lensing. We hope that future observations and experiments will provide some distinguished features 
for the modification of gravity from General Relativity. 
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